成功的材料选择对于设计和制造产品的设计自动化至关重要。设计师通过通过性能，制造性和可持续性评估选择最合适的材料来利用他们的知识和经验来创建高质量的设计。智能工具可以通过提供从先前的设计中学到的建议来帮助具有不同专业知识的设计师。为了实现这一目标，我们介绍了一个图表表示学习框架，该框架支持组装中身体的物质预测。我们将材料选择任务作为节点级预测任务，对CAD模型的汇编图表示，并使用图形神经网络（GNN）对其进行处理。在Fusion 360画廊数据集上执行的三个实验协议的评估表明我们的方法的可行性，达到了0.75 TOP-3 Micro-F1分数。提出的框架可以扩展到大型数据集，并将设计师的知识纳入学习过程。这些功能使该框架可以作为设计自动化的推荐系统以及未来工作的基准，从而缩小了人类设计师与智能设计代理之间的差距。

We present the Group Propagation Vision Transformer (GPViT): a novel nonhierarchical (i.e. non-pyramidal) transformer model designed for general visual recognition with high-resolution features. High-resolution features (or tokens) are a natural fit for tasks that involve perceiving fine-grained details such as detection and segmentation, but exchanging global information between these features is expensive in memory and computation because of the way self-attention scales. We provide a highly efficient alternative Group Propagation Block (GP Block) to exchange global information. In each GP Block, features are first grouped together by a fixed number of learnable group tokens; we then perform Group Propagation where global information is exchanged between the grouped features; finally, global information in the updated grouped features is returned back to the image features through a transformer decoder. We evaluate GPViT on a variety of visual recognition tasks including image classification, semantic segmentation, object detection, and instance segmentation. Our method achieves significant performance gains over previous works across all tasks, especially on tasks that require high-resolution outputs, for example, our GPViT-L3 outperforms Swin Transformer-B by 2.0 mIoU on ADE20K semantic segmentation with only half as many parameters. Code and pre-trained models are available at https://github.com/ChenhongyiYang/GPViT .

This study focuses on embodied agents that can follow natural language instructions to complete complex tasks in a visually-perceived environment. Existing methods rely on a large amount of (instruction, gold trajectory) pairs to learn a good policy. The high data cost and poor sample efficiency prevents the development of versatile agents that are capable of many tasks and can learn new tasks quickly. In this work, we propose a novel method, LLM-Planner, that harnesses the power of large language models (LLMs) such as GPT-3 to do few-shot planning for embodied agents. We further propose a simple but effective way to enhance LLMs with physical grounding to generate plans that are grounded in the current environment. Experiments on the ALFRED dataset show that our method can achieve very competitive few-shot performance, even outperforming several recent baselines that are trained using the full training data despite using less than 0.5% of paired training data. Existing methods can barely complete any task successfully under the same few-shot setting. Our work opens the door for developing versatile and sample-efficient embodied agents that can quickly learn many tasks.

We study the classic facility location setting, where we are given $n$ clients and $m$ possible facility locations in some arbitrary metric space, and want to choose a location to build a facility. The exact same setting also arises in spatial social choice, where voters are the clients and the goal is to choose a candidate or outcome, with the distance from a voter to an outcome representing the cost of this outcome for the voter (e.g., based on their ideological differences). Unlike most previous work, we do not focus on a single objective to optimize (e.g., the total distance from clients to the facility, or the maximum distance, etc.), but instead attempt to optimize several different objectives simultaneously. More specifically, we consider the $l$-centrum family of objectives, which includes the total distance, max distance, and many others. We present tight bounds on how well any pair of such objectives (e.g., max and sum) can be simultaneously approximated compared to their optimum outcomes. In particular, we show that for any such pair of objectives, it is always possible to choose an outcome which simultaneously approximates both objectives within a factor of $1+\sqrt{2}$, and give a precise characterization of how this factor improves as the two objectives being optimized become more similar. For $q>2$ different centrum objectives, we show that it is always possible to approximate all $q$ of these objectives within a small constant, and that this constant approaches 3 as $q\rightarrow \infty$. Our results show that when optimizing only a few simultaneous objectives, it is always possible to form an outcome which is a significantly better than 3 approximation for all of these objectives.

In order to assist the drug discovery/development process, pharmaceutical companies often apply biomedical NER and linking techniques over internal and public corpora. Decades of study of the field of BioNLP has produced a plethora of algorithms, systems and datasets. However, our experience has been that no single open source system meets all the requirements of a modern pharmaceutical company. In this work, we describe these requirements according to our experience of the industry, and present Kazu, a highly extensible, scalable open source framework designed to support BioNLP for the pharmaceutical sector. Kazu is a built around a computationally efficient version of the BERN2 NER model (TinyBERN2), and subsequently wraps several other BioNLP technologies into one coherent system. KAZU framework is open-sourced: https://github.com/AstraZeneca/KAZU

分布式机器学习实现可扩展性和计算卸载，但需要大量的通信。因此，分布式学习设置中的沟通效率是一个重要的考虑因素，尤其是当通信是无线且采用电池驱动设备时。在本文中，我们开发了一种基于审查的重球（CHB）方法，用于在服务器工作者体系结构中分布式学习。除非其本地梯度与先前传播的梯度完全不同，否则每个工人的自我审查员。 HB学习问题的显着实际优势是众所周知的，但是尚未解决降低通信的问题。 CHB充分利用HB平滑来消除报告的微小变化，并证明达到了与经典HB方法相当的线性收敛速率，以平滑和强烈凸出目标函数。 CHB的收敛保证在理论上是合理的，对于凸和非凸案。此外，我们证明，在某些情况下，至少可以消除所有通信的一半，而不会对收敛率产生任何影响。广泛的数值结果验证了CHB在合成和真实数据集（凸，非凸和非不同情况）上的通信效率。鉴于目标准确性，与现有算法相比，CHB可以显着减少通信数量，从而实现相同的精度而不减慢优化过程。

Systems Biology试图创建生物系统的数学模型，以减少固有的生物学复杂性，并为治疗性开发等应用提供预测。但是，确定哪种数学模型正确以及如何最佳地到达答案仍然是一个挑战。我们提出了一种使用系统生物学和可能性无推理方法的数学模型选择自动生物学模型选择的算法。我们的算法显示，在实验生物学和随机搜索中使用的常规启发式方法的先验信息中，在正确的模型中表现出了改善的性能。该方法显示有望加速生物基础科学和药物发现。

可以与其他代理人互动以完成给定任务的自主代理的发展是人工智能和机器学习研究的核心领域。为了实现这一目标，自主代理研究小组开发了用于自主系统控制的新型机器学习算法，特别关注深度强化学习和多代理强化学习。研究问题包括可扩展的协调代理政策和代理间沟通；从有限观察的情况下对其他代理的行为，目标和组成的推理；以及基于内在动机，课程学习，因果推断和代表性学习的样品学习。本文概述了该小组正在进行的研究组合，并讨论了未来方向的开放问题。

临时团队合作（AHT）是创建一个必须与以前看不见的队友合作而没有事先协调的问题。许多现有的AHT方法可以归类为基于类型的方法，这些方法需要一组预定义的队友进行培训。为训练设计队友类型是一个具有挑战性的问题，它决定了在训练期间与队友类型打交道时的代理商的概括性能。在这项工作中，我们提出了一种基于最大化最佳响应多样性指标的不同队友类型的方法。我们表明，我们提出的方法会产生队友类型，这些类型需要在协作期间从学习者那里获得更广泛的最佳反应，这可能会提高学习者在AHT中的稳健性与替代方法相比。

我们提出了小说的少量团队合作（FST）问题，在该问题中，在团队中训练有素的熟练代理人完成一项任务与来自不同任务的熟练代理相结合，并且必须共同学习适应一个看不见但相关的任务。我们讨论如何将FST问题视为解决两个单独的问题：一种减少培训代理团队完成复杂任务所需的经验；与陌生队友合作完成了一项新任务。解决FST的进展可能会导致多方面的强化学习和临时团队合作的进步。